Papers with Olmo-2 model family
Diverse, not Short: A Length-Controlled Data Selection Strategy for Improving Response Diversity of Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Diverse language model responses are crucial for creative generation, open-ended tasks, and self-improvement training. |
| Approach: | They propose a length-controlled data selection strategy that improves diversity while maintaining length parity. |
| Outcome: | The proposed method improves diversity while maintaining length parity on LLaMA-3.1-8B and Olmo-2 family. |